Task: Evaluation of SW tool
Classification of the SW tool provides inputs to the methods used for the qualification process.
Purpose
To determine the SW tool classification. This is a 2 stage process whereby first the theTool Impact (TI) and Tool Error Detection levels are determined, from this the Tool Confidence Level (TCL) is derived.
Relationships
RolesPrimary: Additional: Assisting:
InputsMandatory: Optional:
  • None
External:
  • None
Outputs
Main Description

To carry out the classification task a description of the software tool use cases are captured, these are then analyzed and evaluated to determine if  an erroneous output or malfunction by the software tool could result in the possibility of a violation of safety related requirement allocated to a safety-related item or element. This leads to the Tool Impact or TI value.

The Tool Error Detection or TD value is based upon the probability of preventing or detecting that a software tool is malfunctioning or producing erroneous output.

The TD and TI are then used to determine the Tool Confidence Level or TCL.

The user is advised to refer to ISO 26262, vol 8, clauses 11 for detail on the requirements for the evaluation of the software tool.

Steps
Capture supporting material required for the evaluation

To evaluate the SW tool properly the following information should be available

A description of the functions, feature and technical details of the software tool

User manuals and tool guides

Description of its required operating environment

Details of how the software behaves under irregular operating conditions.

Known software tool malfunctions and the appropriate safeguards, avoidance or work- around measures.

Measures for the detection of the malfunctions


Describe the intended usage of the software tool

The description of how the software tool is used should contain the intended purpose of the tool, its inputs and expected outputs and the applicable environment and functional constraints.


Analyse and evalute the intended usage of the software tool

This task is required to determine the Tool Impact (TI) and the Tool error Detection (TD) of the software tool.

The Tool Impact is determined based upon the possibility that a malfunction of a particular software tool can introduce or fail to detect errors in a safety-related item or element being developed.

TI1 shall be selected when there is an argument that there is no such possibility;

TI2 shall be selected in all other cases;

The Tool error detection is determined based upon the confidence in the measures in the software tool that prevent the software tool from malfunctioning and producing corresponding erroneous output, or in measures that detect that the software tool has malfunctioned and has produced corresponding erroneous output.

TD1 shall be selected if there is a high degree of confidence that a malfunction and its corresponding erroneous output will be prevented or detected.

TD2 shall be selected if there is a medium degree of confidence that a malfunction and its corresponding erroneous output will be prevented or detected.

TD3 shall be selected in all other cases.

NOTE 1 Prevention or detection can be accomplished through process steps, redundancy in tasks or software tools or by rationality checks within the software tool itself.

NOTE 2 TD3 typically applies if there are no systematic measures in the development process available, and therefore malfunctions of the software tool and their corresponding erroneous outputs can only be detected randomly.

NOTE 3 If a software tool is used to verify the output from another software tool, the interdependency between those software tools is considered when evaluating the subsequent software tool and an adequate TD is selected for this subsequently used software tool.

TI and TD should be estimated conservatively if the correct selection is unclear or doubtful.

TD2 shall not be selected If a software tool is used for the tailoring of the development process in such a way that activities or tasks required by ISO 26262 are omitted.

The TI and TD values are used to determine the confidence level of the software tool.

If the Tool Impact has a value of TI1 then the TCL level is TCL 1 irrespective of TD level

If the Tool Impact has a value of TI2 then the TCL increases with respect the Tool error detection level so that

if TD = TD1 then TCL = TCL1

if TD = TD2  then TCL = TCL2

if TD = TD3  then TCL = TCL3

This information is a summary of the information taken from ISO 26262 vol 8, clause 8.11 Table 3- Determination of the Tool Confidence Level.

Document analysis

Documentation provides input to the Software Tool Criteria report

Properties
Multiple Occurrences
Event Driven
Ongoing
Optional
PlannedYes
Repeatable